Multi-path data processing pipeline

ABSTRACT

A print data processing pipeline for use in a color electrophotographic printer optimizes print quality and minimizes memory usage by separately processing lossy and lossless print data. Lossy print data may include print data or images and lossless print data may include print data for text, line art, and graphics. Partitioning print data into lossy and lossless components allows application of the print data compression operations optimized for each type of print data. High compression ratios can be achieved on lossy print data by applying visually lossless compression operations designed for the lossy print data. In addition, high compression ratios can be achieved on the lossless print data by applying lossless compression operations designed for the lossless print data. A merge unit combines the lossy and lossless print data streams after decompression to reconstruct the original image. Placement of the color space conversion operation and the halftone operation relative to the merge operation, further optimizes the print quality while minimizing memory usage. The print data processing pipeline includes a direct memory access controller which has the capability to allow print data to be selectively directed to the lossy or lossless compressor/decompressor, the color space converter, or the merge unit. Feedback paths within the print data processing pipeline allow the results of the various operations performed to be returned to the direct memory access controller for further processing or storage in system memory. Bypass paths in the color space converter and halftone unit allow print data to be selectively directed around these operations. These capabilities allow configuration of the print data processing pipeline to perform a multitude of permutations of print data processing operations optimized for the print data.

CROSS REFERENCE TO RELATED APPLICATIONS

This application includes subject matter related to co-pendingapplication entitled: "DATA MERGE UNIT" having attorney's docket number10960110-1, the co-pending patent application entitled: "METHOD ANDAPPARATUS FOR HALFTONING OF IMAGES IN A PRINTER" having attorney'sdocket number 10960185-1, the copending patent application entitled:"CONFIGURABLE DATA PROCESSING PIPELINE" having attorney's docket number10961184-1, and the co-pending patent application entitled: "MERGE PLANEGENERATION FOR A DATA PROCESSING PIPELINE" having attorney's docketnumber 10970521-1, each of which are incorporated by reference herein,assigned to the same assignee as this application, and filed on evendate herewith.

TECHNICAL FIELD OF THE INVENTION

This invention relates to the processing of data, and more particularlyto the architecture of a print data processing pipeline in a printer.

BACKGROUND OF THE INVENTION

The print data pipeline of a printer performs a number of operationsupon print data which enters the pipeline in preparation for printing.These operations include: print data compression, print datadecompression, color space conversion, and halftoning. The type ofoperation performed and the specific order in which the operations willbe performed can vary depending upon the type of print data which entersthe pipeline, the capabilities of the print engine, and the memoryavailable in the printer. The types of print data which may enter thepipeline include: text, line art, images, and graphics. In prior artpipeline implementations, the various processing operations areperformed by a processor under the control of firmware. Depending uponthe type of print data entering the pipeline, a number of possiblefirmware routines are executed, as necessary, to complete theaforementioned operations.

The specifics of the print data compression operation performed dependupon the type of print data which enters the pipeline. For example, withcertain types of print data, such as image print data, print datacompression routines which result in some loss of information areacceptable. With these types of print data, the decrease in the qualityof the printed output is not perceptible. Compression routines whichresult in a loss of information not perceptible in the printed outputare referred to as "visually lossless" systems However for other typesof print data, such as text and line art, it is important, for thequality of the printed output, that the print data compression routinesemployed do not result in the loss of information.

Data compression/decompression systems, which are known in the art,encode a stream of digital data signals into compressed digital codesignals and decode the compressed digital code signals back into theoriginal data. Data compression refers to any process that attempts toconvert data in a given format into an alternative format requiring lessspace than the original. The objective of data compression systems is toeffect a savings in the amount of storage required to hold a given bodyof digital information. When that digital information is a digitalrepresentation of an image or text, data compression systems are dividedinto two general types: lossy, and lossless.

The lossless systems have what is referred to as reciprocity. In orderfor the data compression system to posses the property of reciprocity itmust be possible to re-expand or decode the compressed data back intoits original form without any alteration or loss of information. Thedecoded and original data must be identical and indistinguishable withrespect to each other. Thus, the property of reciprocity is synonymousto that of strict noiselessness used in information theory.

Some applications do not require strict adherence to the property ofreciprocity. As stated above, one such application in particular, iswhen dealing with image data. Because the human eye is not sensitive tonoise, some alteration or loss of information during the compression anddecompression process is acceptable. This loss of information gives thelossy data compression systems their name.

An important criteria in the design of data compression systems is thecompression effectiveness, which is characterized by the compressionratio. The compression ratio is the ratio of data size in uncompressedform divided by the size in compressed in form. In order for data to becompressible the data must contain redundancy. Compression effectivenessis determined by how effectively the compression procedure uses theredundancy in the input data. In typical computer stored data,redundancy occurs both in the non-uniform usage of individual symbology,for example digits, bytes, or characters, and in frequent reoccurrenceof symbol sequences, such as common words, blank record fields and thelike.

The data compression system should provide sufficient performance withrespect to the data rates provided by and accepted by the printer. Therate at which data can be compressed is determined by the input dataprocessing rate of the compression system. Sufficient performance isnecessary to maintain the data rates achieved and prevent interruptionof printing because processed data is not available. Thus, the datacompression and decompression system must have enough data bandwidth soas not to adversely effect the overall system.

Typically, the performance of data compression and decompression systemsis limited by the computations necessary to compress and decompress andthe speed of the system components such as random access memory and thelike, utilized to store statistical data and guide the compressionprocess. This is particularly true when the compression anddecompression systems are implemented in firmware, wherein firmwareguides a general purpose type central processing unit to perform thedata compression and decompression process. In such a system,performance for a compression device is characterized by the number ofprocessor cycles required per input character during compression. Thefewer the number of cycles, the higher the performance. The firmwaresolutions are limited by the speed of the firmware compression anddecompression because firmware takes several central processor unitcycles to decompress each byte. Thus, the firmware process generally wastailored to decrease compression ratios in order to increasedecompression speed.

General purpose data compression procedures are known in the prior art;three relevant procedures being the Huffman method, the Tunstall methodand the Lempel-Ziv method. One of the first general purpose datacompression procedures developed is the Huffman method. Brieflydescribed, the Huffman method maps full length segments of symbols intovariable length words. The Tunstall method, which maps variable lengthsegments of symbols into fixed length binary words, is complimentary tothe Huffman procedure. Like the Huffman procedure, the Tunstallprocedure requires a foreknowledge of the source data probabilities.Again this foreknowledge requirement can be satisfied to some degree byutilizing an adaptive version which accumulates the statistic strengthprocessing of the data.

The Lempel-Ziv procedure maps variable length segments of symbols intovariable length binary words. It is asymptotically optimal when thereare no constraints on the input or output segments. In this procedurethe input data string is parsed into adaptively grown segments. Each ofthe segments consists of an exact copy of an earlier portion of theinput string suffixed by one new symbol from the input data. The copywhich is to be made is the longest possible and is not constrained tocoincide with an earlier parsed segment. The code word which representsthe segment in the output contains information consisting of a pointerto where there earlier copy portions begin, the length of the code, andthe new symbol. Additional teaching for the Lempel-Ziv data compressiontechnique can be found in the U.S. Pat. No. 4,558,302 incorporatedherein by reference.

While the aforementioned data compression procedures are good generalpurpose lossless procedures, some specific types of redundancy may becompressed using other methods. One such lossless method commonly knownas run length encoding (RLE), is well suited for graphical image data.With RLE, sequences of individual characters can be encoded as a countfield plus an identifier of the repeated character. Typically, twocharacters are needed to mark each character run, so that this encodingwould not be used for runs of two or fewer characters. However, whendealing with a graphical image represented in digital data form, therecan be large runs of the same character in any given line making RLE aneffective compression procedure for such information.

All of the aforementioned data compression procedures are highlydependent upon redundancy in the data to achieve significant compressionratios. One significant disadvantage with these procedures, is that withcertain types of data, the compressed output may actually be larger thanthe input because input data lacks any specific redundancy. In the artof printing, such "incompressible" data is easily generated. Certaintypes of images are classified as either "ordered dither" or "errordiffused". An ordered dither image (also called "cluster") is ahalf-tone image that includes half-tone gray representations throughoutthe page. Such images generally reflect substantial data redundancy andlend themselves to lossless techniques of data encoding such as thosedescribed above. However, error diffused images (also called"dispersed") exhibit little redundancy in their data and requiredifferent methods of compression. Print data representing photographicimages provides another example of low redundancy print data. As aresult, the use of a single data compression scheme in a page printer nolonger enables such a printer to handle image data. In U.S. Pat. No.5,479,587 entitled "Page Printer Having Adaptive Data Compression ForMemory Minimization", issued to Cambell et al., assigned to the sameassignee as this application and incorporated herein by reference, apage printer steps through various compression techniques as outlined inan attempt to accommodate a limited memory size that is less than thatrequired for a full page of printed data. In that application, when animage is unprintable because of memory low conditions, first a "mode-M"compression technique is used. Using this technique, an attempt is madeto compress the block using run length encoding for each row and byencoding delta changes that occur from row to row within the block. Ifthe "mode-M" compression technique is unsuccessful in providing enoughof a compression ratio to allow printing of the page, a second attemptis made using an LZW type compression. Finally, if the LZW basedcompression technique is unsuccessful in obtaining a high enoughcompression ratio to allow printing of the page, a lossy compressionprocedure is used.

In the processing of raster print data, a variety of operations can beperformed on the raster print data prior to generating the printed page.Such operations as data compression, color space conversion, andhalftoning are included in the operations which may be performed priorto generating the printed page. It is frequently the case, that in theprocessing of raster print data various sections of the page would beoptimally processed by employing different types of data compression,color space conversion, and halftoning operations. A reoccurring problemconfronted in optimally processing raster print data has been thepartitioning of the raster print data forming the page so that thevarious raster print data processing operations may be optimallyperformed on the appropriate sections of the page.

Consider, for example, the amount of memory required to store the rasterprint data corresponding to a page. As printers increase in the densityof dot placement (dots per inch), add gray scale capability (using anumber of bits per pixel to define a gray scale level), and includecolor printing capability (requiring additional bits per pixel overmonochrome printing), the memory required to store the data used toprint a page can reach thirty two times the memory required formonochrome printer of the same resolution. To allow the color printersto use a more reasonable memory size, data compression techniques aregenerally used to reduce the memory requirements. However, differenttypes of raster print data are each optimally compressed using differentcompression techniques. For example, for raster print data correspondingto sections of the page containing images, the optimal combination ofcompression ratio and print quality is achieved by employing lossycompression techniques. However, for raster print data corresponding tosections of the page containing text the optimal combination ofcompression ratio and print quality is achieved by employing losslesscompression techniques. A need exists for a data processing pipelinewhich will allow application of the optimal type of data processingoperation to the processing of each data element.

SUMMARY OF THE INVENTION

A data processing pipeline for separately processing a plurality of datastreams each formed from a plurality of data elements, such as bytes orwords of print data, allows optimization of the data pipeline processingoperations for each data element. The data processing pipeline uses amerge data stream defined by the plurality of data streams and formed ofmerge data elements corresponding to the data elements. The plurality ofdata streams may be formed, for example, by partitioning a source datastream, such as a print data stream, data element by data element, basedupon the characteristics of each of the data elements. Depending uponthe characteristics, the source data stream may be optimally partitionedinto more than two data streams. For the case in which the dataprocessing pipeline is used to process raster print data, the stream ofraster print data may be partitioned at the pixel level. For example,those pixels associated with lossy regions of the page form the lossyraster print data stream and those pixels associated with losslessregions of the page form the lossless raster print data stream. Dataprocessing pipeline operations, such as data compression, may then beselected to achieve the optimal combination of compression ratio andprint quality for each pixel on the page.

The stream of raster print data may also be partitioned based upon thenumber of bits used to represent each of the pixels. In the extremecase, pixels corresponding to regions of the page which will be printedin color may require 24 bits to represent each of the pixels, whilepixels corresponding to regions of the page which will be printed inblack and white may only require 1 bit to represent each of the pixels.By partitioning the stream of raster print data based upon the number ofbits used to represent each of the pixels, compression operationsoptimized for the number of bits per pixel may be used. In addition, thestream of raster print data including pixels of binary black and whitedata may not require a color space conversion operation, whereas thestream of raster print data including pixels of color data may require acolor space conversion operation.

A further possible partition of the stream of raster print data may bebased upon the desired printing resolution of the areas of the pagecorresponding to the pixels. For example, the edges of vector graphicsobjects or the edges of objects within images generally, for printquality reasons, benefit from higher resolution, while areas interior tothe vector graphics objects or interior to the objects within images maybe printed with lower resolution without sacrificing print quality.Partitioning a raster print data stream on the basis of resolution wouldallow a reduction in the amount of data requiring processing by the dataprocessing pipeline, thereby reducing the time required to print pages.In addition, halftone and compression operations may be optimized foreach of the partitioned streams of raster print data based upon theresolution of the particular partitioned raster print data stream.

The data processing pipeline includes a first pipeline processing unit,such as a lossless compressor/decompressor, a halftone unit, a colorspace converter, or a combination thereof. The first pipeline processingunit includes a first input to receive a first one of the plurality ofdata streams. The first pipeline processing unit is configured toperform a first transform, such as a compression operation, adecompression operation, a color space conversion, a halftone operation,or a combination of the aforementioned operations, on the data elementsof the first one of the plurality of data streams to generate a firsttransformed data stream.

The data processing pipeline further includes a second pipelineprocessing unit, such as a lossy compressor/decompressor, a halftoneunit, a color space converter, or a combination thereof. The secondpipeline processing unit includes a second input to receive a second oneof the plurality of data streams. The second pipeline processing unit isconfigured to perform a second transform, such as a compressionoperation, a decompression operation, a color space conversion, ahalftone operation, or a combination of the aforementioned operations onthe data elements of the second one of the plurality of data streams togenerate a second transformed data stream.

The data processing pipeline additionally includes a merge unitconfigured to receive the first transformed data stream and the secondtransformed data stream. The merge unit is configured to merge the firsttransformed data stream and said second transformed data stream into anoutput data stream using the merge data stream.

DESCRIPTION OF THE DRAWINGS

A more thorough understanding of the invention may be had from theconsideration of the following detailed description taken in conjunctionwith the accompanying drawings in which:

FIG. 1 is a high level diagram of a print data processing pipeline.

FIG. 2A is a simplified conceptual block diagram of the flow of printdata through the preferred embodiment of a print data processingpipeline in a color printer.

FIG. 2B is a simplified hardware block diagram of the preferredembodiment of the print data processing pipeline.

FIG. 3 is a conceptual illustration of the merge operation.

FIG. 4 is a high level simplified block diagram of the merge unit.

FIG. 5 is a simplified schematic diagram of the input side of the lossyinput buffer.

FIG. 6 is a simplified schematic diagram of the output side of lossyinput buffer.

FIG. 7 is a simplified schematic diagram of the input side of the lossyand lossless output buffers.

FIG. 8 is a simplified schematic diagram of the output side of the lossyand lossless output buffers.

FIG. 9 is a simplified schematic diagram of the shift registers used forthe halftone and merge print data streams.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention is not limited to the specific exemplaryembodiments illustrated herein. In addition, although the embodiment ofthe print data processing pipeline will be discussed in the context of acolor laser printer, one skilled in the art will recognize afterunderstanding this disclosure that the print data processing pipelinearchitecture disclosed is applicable to other imaging systems for whicha performance advantage is achieved by employing parallel paths tohandle data which has been selectively compressed using either losslessor lossy data compression methods. For example, the disclosed print dataprocessing pipeline may be usefully applied in scanners and digitalphotoprocessing laboratories. Furthermore, any system for generating animage that requires memory for the storage of image data could achieveoptimized image quality while minimizing memory requirements by applyingthe disclosed pipeline architecture.

In color printing, a need exists for a print data processing pipelinewhich reduces the memory required for storing print data whilemaintaining high levels of print quality. The use of a print dataprocessing pipeline architecture which selectively compresses print datausing lossy or lossless compression methods maintains high print qualitywhile minimizing print data memory storage requirements. In addition,correct placement of the operations in the print data processingpipeline provides further improvements in print quality and reductionsin memory storage requirements.

Shown in FIG. 1 is a block diagram of a general implementation of thedata processing pipeline 200 for processing a plurality of data streamsgenerated from a partition of a source data stream formed from aplurality of data elements. Each of the plurality of data streams isformed from the data elements. Although FIG. 1 shows only a first one201 and a second one 202 of the plurality of data streams, it should berecognized that, depending upon the characteristics of the dataelements, the source data stream may be partitioned into more than twodata streams to optimally process the data elements.

A first pipeline processing unit 203 is used to perform a firsttransform on the first one 201 of the plurality of data streams. Thefirst transform performed by first pipeline processing unit 203 may beone or more operations such as data compression or decompression, colorspace conversion, halftoning, or other data processing operations. Themethod of performing the first transform is optimized to thecharacteristics of the data elements forming the first one 201 of theplurality of data streams. The first pipeline processing unit 203generates a first transformed data stream 205.

A second pipeline processing unit 204 is used to perform a secondtransform on the second one 202 of the plurality of data streams. Thesecond transform performed by second pipeline processing unit 204 may beone or more operations such as data compression or decompression, colorspace conversion, halftoning, or other data processing operations. Themethod of performing the second transform is optimized to thecharacteristics of the data elements forming the second one 202 of theplurality of data streams. The second pipeline processing unit 204generates a second transformed data stream 206.

A merge unit 207 receives first transformed data stream 205 and secondtransformed data stream 206. The merge unit 207 merges first transformeddata stream 205 and second transformed data stream 206 into an outputdata stream 208. To perform this merge operation, merge unit 207 uses amerge data stream 209. The merge data stream 209 is formed from mergedata elements and defined by the first one 201 and the second one 202 ofthe plurality of data streams so that data elements of the output datastream 208 resulting from the merge operation have the ordering of thedata elements in the source data stream. Thus, merge unit 207 assemblesfirst transformed data stream 205 and second transformed data stream 206to preserve, in output data stream 208, the ordering of the dataelements in the source data stream.

By partitioning the source data stream to form the first one 201 and thesecond one 202 of the plurality of data streams based upon thecharacteristics of the data elements in the source data stream, thefirst pipeline processing unit 203 and the second pipeline processingunit 204 can each be configured to optimize processing of the dataelements.

Shown in FIG. 2A is a simplified conceptual block diagram of the flow ofprint data through a color printer which includes the preferredembodiment of the print data processing pipeline 15 for a color laserprinter. It should be emphasized that FIG. 2A is intended to illustrateonly the flow of print data, using parallel lossy and lossless paths,through typical operations performed by print data processing pipeline15. FIG. 2A is not a hardware block diagram of the print data processingpipeline 15. As will become apparent from the later description of thehardware block diagram, the print data processing pipeline 15 may beconfigured in a variety of different ways to optimize processing of theprint data.

The print data input to the system could come in several differentformats. The input print data could be in the form of a display list,raster print data, or raster print data which has already undergonecompression. The display list print data consists of the informationnecessary to construct the pages to be printed. Display list print datamay include raster print data along with codes identifying the rasterprint data as text or image print data, printer control language codesrepresenting text characters, graphics language codes representing agraphics image, or some combination of each of these types of printdata. Conceptually, print data will enter the print data processingpipeline 15 at the appropriate location depending upon the processingrequired to transform the print data to the form necessary forgenerating the printed output.

Image processing is performed on display list print data in imageprocessing operation 1 by execution of firmware routines. Included inthis image processing operation 1 is the partitioning of the input intopage strips. The display list print data is sorted, based upon thevertical position on the page to which it corresponds, for partitioninginto page strips. The partitioning of the page into page strips in imageprocessing operation 1 involves consideration of the type of print dataforming the section of the page corresponding to the page strip whichwill be formed. Each page strip is formed of either one or two pagestrip elements. If the section of the page is formed from eitherentirely lossy or entirely lossless print data, only a single element ofthe page strip will be formed in image processing operation 1 for thatsection of the page. However, if the display list print data for thatsection includes both lossy and lossless print data, two separate pagestrip elements are formed for that section of the page. One of thesepage strip elements includes only lossy print data and the other ofthese page strip elements includes only lossless print data.

Formation of lossy and lossless page strip elements for thecorresponding section of the page occurs when both types of data arepresent in the display list print data. In this case, the imageprocessing operation 1 builds each of the two page strip elements byfilling both the lossy and lossless page strip elements, pixel locationby pixel location, with, as is appropriate, the lossy or lossless printdata from the page section. Included within the lossy and lossless pagestrip elements is the print data for that section of the page. Forexample, if the display list print data includes lossless text printdata along with lossy image print data, image processing operation 1will separate the display list print data into the text print data andthe image print data. Then, each of the lossless and lossy page stripelements will be filled, pixel location by pixel location, with therespective text print data and the image print data. In this case, thepage strip corresponding to the display list print data can be regardedas a composite page strip including the page strip elements containinglossy image print data which is overlaid with a page strip elementcontaining the lossless text print data.

For the case in which lossy and lossless page strip elements are formed,the image processing operation 1 produces a corresponding merge plane.This merge plane consists of a single bit for each pair of correspondingpixel locations in the two page strip elements for indicating in whichof the lossy and lossless page strip elements the print data for thatpixel is contained. The bits forming the merge plane are formed intobytes and transferred through the print data processing pipeline 15 as astream of bytes. This merge plane is used at a later stage in the printdata processing pipeline 15 to combine the lossy and lossless page stripelements so that the original page strip is reconstructed. This mergeoperation will be discussed in greater detail later in thisspecification.

For the case in which one page strip element is formed having only lossyor only lossless print data, all of the print data for that page stripis contained within that single page strip element. In addition, themerge plane associated with that page strip element is not generated bythe image processing operation 1. Because there is only a single pagestrip element for that section of the page, every bit in the merge planewould be identical. Therefore, it is not necessary to send a merge planeconsisting of bytes of all the same value through the print dataprocessing pipeline 15. Instead of generating the merge plane in imageprocessing operation 1, the merge plane is generated at a later stage inthe print data processing pipeline 15. This will be discussed in moredetail later in this specification.

Image processing operation 1 also produces a halftone plane with onevalue corresponding to each pixel location in the page strip As will bediscussed later in this specification, each halftone value isrepresented by two bits and determines the halftoning operation appliedto the print data corresponding to the pixel. In the event that thehalftoning operations to be performed are the same for each pixel in thepage strip, the halftone plane will not be generated in the imageprocessing operation 1. Instead, the halftone plane will be generated ata later stage in the print data processing pipeline 15. This will bediscussed in more detail later in this specification.

From the display list print data which has been partitioned into pagestrip elements, raster print data is generated corresponding to thedisplay list print data. The resulting page strip elements of rasterprint data are passed through the operations of print data processingpipeline 15 as they are generated. Raster print data memory 2 is used tostore raster print data generated by image processing operation 1. Thememory space allocated to raster print data memory 2 is of sufficientstorage capacity to contain the raster print data for two page stripelements of the maximum allowable number of lines per page strip, thecorresponding size merge plane, and the corresponding size halftoneplane. Each of the page strip elements is rasterized in image processingoperation 1, stored in the memory space allocated to raster print datamemory 2, and then sent to the next operation in the print dataprocessing pipeline 15 to create space in raster print data memory 2 forthe next page strip elements rasterized in image processing operation 1.It should be noted that in the preferred embodiment, raster print datamemory 2 is not included in the integrated circuit in which the printdata processing pipeline 15 is implemented.

Typically, the generated raster print data consists of three eight bitbytes for each pixel. Each of the three bytes corresponds to one of thecolor dimensions in the color space in which the display list print datais expressed. For the color printer in which the preferred embodiment ofthe print data processing pipeline operates, this is an RGB color space.However, one skilled in the art will recognize that the color space ofthe input print data could be any color space such as, cyan, magenta,yellow, black (CMYK); hue, saturation, value (HSV); hue, lightness,saturation (HLS); luminance, red-yellow scale, green-blue scale (La*b*);luminance, red-green scale, yellow-blue scale (Luv); Luminance, red-bluescale, green-yellow scale (YCrCb); or YIQ. The generated raster printdata could correspond to images, text, line art, graphics or somecombination thereof.

As previously mentioned, image processing operation 1 creates the mergeplane for the case in which the display list print data is such that alossy and a lossless page strip element are formed. At a later locationin the print data processing pipeline, the merge bits are used to selectpixels from the pair of corresponding lossy and lossless page stripelements to combine the lossy and lossless page strip elements, whilemaintaining the correct spatial relationship between the pixels, intothe original image.

Color space conversion is performed in color space conversion operation3. The degree of compression achieved on the raster print data isaffected by the color space in which the raster print data is expressed.For example, a higher lossy compression ratio, with equivalent imagequality, can generally be achieved by performing a color spaceconversion from a RGB color space to a YCbCr color space and performingthe lossy compression operation after conversion to the YCbCr colorspace. The YCbCr color space is a luminance/hue/chroma type color spacein which the Cr and Cb components of the color space each include bothhue and chroma information. The human eye is most sensitive to changesin the luminance and relatively less sensitive to changes in the chroma.Because of this, print data expressed in this color space includes asignificant amount of redundancy in the Cr and Cb components. As aresult, lossy compression can be performed on the lossy page stripelement of raster print data with a relatively large compression ratio.This color space dependent compression ratio advantage does not existfor lossless compression. For this reason, lossless page strip elementsdo not undergo color space conversion from the RGB color space to theYCbCr color space. Although, if this color space conversion wererequired for other reasons, it could be performed. At a later stage inthe print data processing pipeline, both the lossless page stripelements and the lossy page strip elements will undergo color spaceconversion from the RGB or YCbCr color space to the CMYK colorspecification. This color space conversion will be discussed in moredetail later in this specification.

Forming a lossy and a lossless page strip element from a section of thepage corresponding to a single page strip and, in addition, generating amerge plane and a halftone plane, increases the amount of data sentthrough the print data processing pipeline 15. The merge bit and the twohalftone bits associated with each pixel increase the amount of printdata. However, because high compression ratios can be achieved for thelossy and lossless page strip elements, and because the merge plane andthe halftone plane also undergo lossless compression, the memory spacerequired to contain the print data is only slightly increased in theworst case. But, the resulting improvement in the print quality overpipelines which do not apply different data compression algorithms tolossy and lossless data is substantial. For most print jobs, the printdata will be either all lossy or all lossless. For these cases, the onlyincrease in the amount of raster print data sent through the print dataprocessing pipeline 15 from the image processing operation 1 will be thehalftone plane if there are different halftone algorithms applied to thepixels of the page strip. If the same halftone algorithms will beapplied to all the pixels of the page strip, no halftone plane will begenerated in image processing operation 1.

Raster print data may be directly input to the print data processingpipeline. The raster print data may come from a scanner or from the hostcomputer. The device that provides the raster print data also provides aheader used by image processing operation 1 to form the page strips.Included in this header is information which the image processingoperation 1 can use to separate the raster print data as lossy orlossless for the image processing operation 1.

Before the page strip elements of lossy raster print data undergo lossycompression, the Cr and Cb components of the color space converted pagestrip elements of raster print data are selectively reduced to decreasethe amount of print data the print data processing pipeline 15 musthandle, thereby increasing the data throughput and reducing the amountof memory necessary to hold the raster print data. The previouslymentioned redundancy in the Cr and Cb components allows this rasterprint data subsampling to be accomplished while maintaining the visuallylossless characteristic of the raster print data. The subsamplingoperation is performed in the lossy compression operation 5. The lossycompressor operation 5 performs compression on blocks of raster printdata formed from sections eight pixels in width along a scan line andeight successive scan lines in height. Through subsampling, the totalnumber of these eight pixel by eight pixel blocks is reduced.

The amount of subsampling which occurs depends upon the amount of datareduction necessary to allow the raster print data to fit into thememory space available. If sufficient memory space is available,subsampling will be performed to reduce the amount of lossy raster printdata in the page strip element by one third. If necessary for fittingthe lossy raster print data into memory, the subsampling will beperformed to reduce the amount of lossy raster print data in the pagestrip element by one half.

The subsampling to achieve a reduction of one third is achieved asfollows. Consider, for example, three groups of lossy raster print datawith each group representing four eight by eight blocks of pixels fromone color plane. A first group is formed from the luminance component, asecond group is formed from the Cr component, and a third group isformed from the Cb component. There are a total of twelve blocks oflossy raster print data. In the second group, for each of the eight scanlines in each of the four blocks, only the lossy raster print datacorresponding to alternating pixels along each scan line, beginning withthe first pixel of each scan line in each block, is kept. As a result,for each scan line of each of the four blocks, the eight pixel width isreduced to four pixels. In this manner, the four blocks of the Crcomponent are subsampled down to two blocks. The subsampling of the Cbcomponent from four blocks down to two blocks is accomplished in asimilar fashion. After this subsampling, of the original twelve blocksof pixels, eight are remaining, yielding a reduction of one third.

The subsampling to achieve a reduction of one half is done by applyingthe same subsampling procedure used to achieve a reduction of one thirdto the remaining two blocks of the Cr component and the two blocks ofthe Cb component. Applying the same subsampling procedure to theremaining blocks of the Cr and Cb component results in a single blockfor the Cr component and a single block for the Cb component. After thissecond pass of subsampling, of the original twelve blocks of pixels, sixare remaining, yielding a reduction of one half.

After the subsampling operation is performed, the lossy compressionalgorithm is applied to the page strip element in the lossy compressionoperation 5. In the preferred embodiment of the print data processingpipeline 1 5, the lossy compression method employed is the well knownJPEG algorithm. The JPEG lossy compression method was selected becausepreviously developed hardware to implement this method was readilyavailable. However, any lossy compression method, such as vectorquantization, could have been used. If there is a lossless page stripelement, compression of this page strip element is performed in losslesscompression operation 4. In addition, if there is a merge and a halftoneplane corresponding to the page strip elements, both of these arecompressed in lossless compression operation 4. The preferred embodimentof the print data processing pipeline 15 employs the type of Lempal-Zivlossless compression/decompression method disclosed in U.S. Pat. No.5,455,576, the disclosure of which is incorporated by reference herein.However, any lossless compression/decompression method, such as JBIG,run length, or delta row compression may also be used. Furtherinformation regarding the techniques used to accomplish lossless andlossy compression can be found in the book "INTRODUCTION TO DATACOMPRESSION", Khalid Sayood, 1996, Morgan Kaufmann Publishers, thedisclosure of which is incorporated by reference herein.

The lossy and lossless compressed raster print data generated by,respectively, the lossy compression operation 5 and the losslesscompression operation 4, is stored in compressed raster print datamemory 6. The space allocated to compressed raster print data memory 6is of sufficient size to hold all three color planes of the compressedlossy and lossless raster print data for an entire page, the compressedhalftone data for an entire page, and the compressed merge data for anentire page. It should be noted that in the preferred embodiment,compressed raster print data memory 6 is not included in the integratedcircuit in which the print data processing pipeline 15 is implemented.Furthermore, it should be emphasized that designation of raster printdata memory 2 and compressed raster print data memory 6 are in aconceptual sense only for the purposes of explaining the operation ofthe print data processing pipeline 15. Both raster print data memory 2and compressed raster print data memory 6 are physically located insystem memory and store print data, whether it is compressed rasterprint data or raster print data on which no compression/decompressionoperations have been performed. Because the memories are distinguishedonly by the type of data stored in them at a given time, locations inthe system memory may be used to store both types of print data atdifferent times.

The raster print data for each pixel of the lossy or the lossless pagestrip elements is represented by three bytes, one byte for each colorspace component of the raster print data. The lossy and lossless pagestrip elements move through the print data processing pipeline 15 in twoparallel channels. Depending upon the location of the print data in theprint data processing pipeline 15, the lossy and lossless raster printdata streams are either a single byte wide or three bytes wide. Lossyand lossless raster print data enters the color space conversionoperations 3, 9, as a three byte wide stream and exits as a single bytewide stream which is packed into a three byte wide stream with each byteof a three byte group representing a dimension of the output colorspace. Lossy and lossless raster print data enters the color spaceconversion operation 12 as a three byte wide stream and exits as asingle byte wide stream. Each byte of a three byte group entering colorspace conversion operations 3, 9, 12 represents raster print datacorresponding to a single dimension of the input color space. Theresulting single byte exiting color space conversion operation 12represents raster print data corresponding to the single dimension ofthe output color space which is undergoing printing. Lossy and losslessprint data exits the image processing operation 1 as a three byte widestream. Lossy and lossless print data enters the lossy 5, 8, 1 1compression and lossless 4, 7, 10 compression operations as a three bytewide stream and exits as a single byte wide stream which is thenbuffered to become a three byte wide stream. Lossy and lossless printdata enters the lossy 5, 8, 1 1 decompression and lossless 4, 7, 10decompression operations as a single byte wide stream and exits as asingle byte wide stream. Lossy and lossless raster print data enters andexits both the merge operation 13 and the halftone operation 14 as asingle byte wide stream.

The plane of merge data is aligned into bytes. Because only a single bitfor each pixel is required for the merge operation, each byte of mergedata contains merge information for eight pixels. The plane of halftonedata is aligned into eight bit bytes. Because two bits for each pixelare required for the halftone operation, each byte of halftone datacontains halftone information for four pixels. Both the halftone planeand the merge plane move through the print data processing pipeline intwo parallel byte wide channels.

By forming lossy and lossless page strip elements and then compressingthe raster print data in these page strip elements using, respectively,lossy or lossless compression methods, the optimal combination of memorycompression and image quality is achieved for the print data. The lossyraster print data can be highly compressed using lossy compressiontechniques while maintaining its visually lossless characteristics. Thelossless raster print data is compressed using lossless compressiontechniques so that no degradation in image quality is experienced, whileachieving high compression ratios. The lossy and lossless compressionmethods selected are optimized for the lossy raster print data (images)and lossless raster print data (text, line art, and graphics) to yieldhigh compression ratios without degrading image quality. This feature isa significant benefit which results from using lossy and lossless pagestrip elements in the print data processing pipeline 15. It should benoted that although the preferred embodiment of the print dataprocessing pipeline 15 uses multiple channels to move the page stripelements of lossy and lossless raster print data and the correspondinghalftone, and merge data through the print data processing pipeline 15,it would be possible to use a single multiplexed channel to successivelytransfer page strip elements of print data. Using a single multiplexedchannel would sacrifice performance for a reduction in the amount ofhardware required.

It is possible to input compressed raster print data into the print dataprocessing pipeline 15. This may happen when compressed raster printdata is input into the print data processing pipeline 15 associated witha command in the display list or as raster print data or compressedraster print data may be input into the print data processing pipeline15 ready for decompression and printing of an entire page. Thiscompressed raster print data may be provided by the host computer or bya scanner through a host computer. Included with this compressed rasterprint data is a header attached by the host computer containinginformation used by image processing operation 1.

Consider the case in which it is desired to overlay a lossy imagepreviously input into the print data processing pipeline 15 as displaylist print data, with a lossy image which is input into the print dataprocessing pipeline 15 as compressed lossy raster print data. For thiscase, a path is provided in the print data processing pipeline 15 forsending the compressed lossy raster print data from compressed rasterprint data memory 6 into lossy decompression operation 8, performing acolor space conversion in color space conversion operation 9 (for thecase in which the compressed lossy raster print data is not expressed inan RGB color space) back to an RGB color space, storing the result inraster print data memory 2, and delivering the decompressed lossy rasterprint data to the image processing operation 1 for performing theoverlay with the previously input lossy image. Image processingoperation 1 then performs the partitioning into lossy page stripelements. It should again be emphasized that this path for combining thecompressed lossy raster print data with the lossless print data is shownin FIG. 2A in a conceptual sense. The actual routes which print datafollows to the hardware functional blocks to accomplish the operationsshown in FIG. 2A will be described later in this specification.

As previously mentioned, the print data processing pipeline 15 is ableto receive raster or compressed raster print data from a variety ofdevices, such as a host computer or a scanner, capable of supplyingprint in that form. Receiving either raster or compressed raster printdata eliminates the need for image processing operation 1 to perform therasterization operation. In addition, if the print data is received ascompressed raster print data ready for printing, it is not necessary toperform the lossy 5 and/or lossless 4 compression operations or performthe color space conversion operation 3.

The functional blocks used to accomplish the operations shown in thepreferred embodiment of the print data processing pipeline 15 areimplemented in a single integrated circuit. The techniques used toimplement these functions in a digital integrated circuit are well knownin the art of digital integrated circuit design. Implementation of thefunctions of the print data processing pipeline 15 in dedicated hardwareprovides superior processing performance for the print data entering thepipeline.

Although it would be possible to perform each of the operations in theprint data processing pipeline 15 using a microprocessor, the print dataprocessing performance would be significantly reduced. Themicroprocessor would be required to alternately handle the lossy andlossless page strip elements to perform the necessary print datacompression, color space conversion, and print data decompressionoperations. In addition, the microprocessor would merge the lossy andlossless pages strip components and perform the halftone operation.

The preferred embodiment of the print data processing pipeline 15operates with a color laser print engine 16 designed to receive printdata expressed in a CMYK color specification. In addition, the printengine 16 operates by sequentially developing the toner for each planeof the CMYK color specification prior to transferring toner to thepaper. The four pass development process used by print engine 16dictates the manner in which raster print data flows through print dataprocessing pipeline 15. Because of this mode of operation of the laserprint engine 1 6, the raster print data for a page is sent in foursuccessive passes, one pass for each dimension of the CMYK colorspecification, to the print engine 16.

As previously mentioned, the compressed raster print data for the entirepage is accumulated in the memory space allocated to the compressedraster print data memory 6 as the lossy and lossless page strip elementsare compressed. The lossy compressed raster print data is expressed in aYCbCr color space. The lossless compressed raster print data isexpressed in a RGB color space. Conversion of the compressed rasterprint data to each of the four planes of the CMYK color specification ofthe laser print engine requires sending of the compressed raster printdata for the page through the print data processing pipeline 15 in foursuccessive passes. In each of these four passes, the lossless and lossycompressed raster print data is sent over two, single byte wide channelsto the respective lossless 10 and lossy 11 decompression operations fordecompressing. Interleaved with the bytes of lossless compressed rasterprint data are the compressed merge planes and the halftone planes. Themerge planes and the halftone planes are interleaved with the losslessraster print data so that they can undergo lossless compression alongwith the lossless raster print data. After decompression the merge planeand the halftone plane are extracted from the stream of decompressedlossless print data. This will be described in greater detail later inthis specification. The lossy compressed print data includes the lossypage strip elements. After decompression of the lossy compressed rasterprint data, an interpolation operation is performed to expand values forthe Cr and Cb components which were eliminated through subsampling priorto compression of the lossy raster print data. The interpolationoperation is performed as part of the lossy decompression operation 11.

After the lossy 11 and lossless 10 decompression operation, both thelossless print data and the lossy print data are sent for color spaceconversion in color space conversion operation 12. Because the printengine 16 uses a four pass development process, the compressed rasterprint data for all color planes of the page is sent four successivetimes through the lossy 11 and lossless 10 decompression operations. Foreach of the four passes of compressed raster print data through thelossless 10 and lossy 11 decompression operations into color spaceconversion operation 12, color space conversion operation 12 generatesone of the four planes of the CMYK color specification. The color spaceconversion operation 12 is performed using the three eight bit bytes oflossy or lossless raster print data which represent each of the pixelsof the page which are to be printed. The raster print data stream outputfrom the color space conversion operation 12 includes two eight bitchannels formed from the lossy raster print data and the lossless rasterprint data. The lossless raster print data input to the color spaceconversion operation 12 is expressed in the RGB color space. The lossyraster print data input to the color space conversion operation 12 isexpressed in the YCrCb color space.

FIG. 2A suggests that lossy 5 and lossless 4 compression operations,lossless 7 and lossy 8 decompression operations, and lossless 10 andlossy 11 decompression operations are accomplished in separate hardwareunits. However, in the preferred embodiment of the print data processingpipeline 15, there is a single hardware unit which performs lossycompression and decompression and there is a single hardware unit whichperforms lossless compression and decompression. These units perform allthe compression/decompression operations for the print data processingpipeline 15. Although for the purposes of describing the print dataprocessing pipeline 15, FIG. 2A shows color space conversion operations3, 9, and 12 as separate hardware units, in the preferred embodiment, asingle color space converter is used to perform all of the necessarycolor space conversions. In the preferred embodiment of the print dataprocessing pipeline 15, the color space converter is that disclosed inthe co-pending application entitled "APPARATUS FOR GENERATINGINTERPOLATOR INPUT DATA", having patent application docket number10960608-1 and the co-pending application entitled "APPARATUS FORROUTING INTERPOLATOR INPUT DATA", having patent application docketnumber 10960467-1, each of which are assigned to the same assignee asthis patent application, and each of which are incorporated herein byreference. One of ordinary skill in the art will recognize afterunderstanding this specification that any color space converter whichcan perform a conversion between the color spaces selected to expressthe lossy and lossless print data and the color specification used bythe laser print engine is suitable for use in a multi-path print dataprocessing pipeline.

Merge operation 13 receives as inputs the lossless raster print datastream, the lossy raster print data stream, the halftone data stream,and the merge data stream. Each of these print data streams is formedfrom a stream of bytes. The print data representing a single color planeof the print engine color specification for each of the pixels of theentire page is contained in the lossless and lossy raster print datastreams. The function of the merge operation 13 is to combine, pixel bypixel, these two raster print data streams so that the original image,previously split into lossless and lossy page strip elements, isreconstructed for the color plane being processed. The bits of the mergedata associated with each pixel are used by merge operation 13 todetermine if the raster print data for the pixel currently beingprocessed is selected from the lossless raster print data stream or fromthe lossy raster print data stream. Subsequent passes of lossy andlossless raster print data through the merge operation 13 reconstructsthe original image for the remaining color planes of the print enginecolor specification. Each of the pixels corresponds to a location onwhat will be the printed page. The reconstruction process can beregarded as a spatial synchronization of the lossless and lossy rasterprint data streams to generate the original image. Furthermore, toachieve the spatial synchronization, the lossless and lossy raster printdata streams and the stream of merge data must be synchronized in time.

The disclosed print data processing pipeline 15 takes advantage of theplane by plane developing characteristic of the print engine 16 toreduce the total memory required to accomplish the printing operation.By placing the merge operation 13 in the print data processing pipeline15 subsequent to the color space conversion operation 12, it is onlynecessary that the merge operation 13 use a minimally sized line bufferfor the storage of raster print data for a single color plane of theprint engine 16 CMYK color specification. Had the merge operation 13been located in the print data processing pipeline 15 prior to the colorspace conversion operation 12, it would be necessary that the mergeoperation 13 use a line buffer of size sufficient to store the rasterprint data for each of the three dimensions of the RGB and YCrCb colorspaces.

It should be recognized that a print data processing pipelinearchitecture which uses separate paths for the lossless and the lossyprint data is compatible with a print engine which operates by receivingthe raster print data for all color planes of the print engine colorspecification in a single pass, instead of multiple passes. For thiscase it would be necessary that the color space conversion operation 12perform a color space conversion on the raster print data representingeach pixel to generate each of the corresponding values for the C, M, Y,and K dimensions simultaneously. This would require that the color spaceconversion operation 12 have the capability to simultaneously performthe interpolations necessary to generate each of the C, M, Y, and Kdimensions. In addition, the merge operation 13 would require a linebuffer of sufficient size to contain raster print data for each of theC, M, Y, and K dimensions.

In the preferred embodiment of the print data processing pipeline 15,the raster print data combined in merge operation 13 is subjected to ahalftoning operation 14. The halftone operation 14 is located so thathalftoning is the last operation performed on the raster print dataprior to the delivery of the print data to the print engine 16. Thehalftone operation 14 performs the halftoning process plane by plane onthe merged raster print data as directed by the halftone print dataassociated with each pixel. Locating the halftone operation 14 after themerge operation 13 allows the halftoning operation 14 to be performedsequentially on each color plane of the color space used by the printengine 16, thereby requiring less memory for storing the raster printdata. In addition, had the halftoning operation 14 been performed priorto the merge operation, the complexity of the halftone operation 14would have been significantly increased because of the necessity ofseparately performing the halftoning operation 14 on the stream oflossless raster print data and on the stream of lossy raster print data.Furthermore, placement of the halftone operation 14 last in the printdata processing pipeline 15 results in the optimum print quality.Locating the halftone operation 14 prior to the compression of the lossyraster print data would have resulted in a loss of some of theenhancements achieved by the halftoning process and the compressionlevel achieved on the halftoned raster print data would be reduced.Additionally, the highest level of print quality is achieved byperforming the halftoning operation 14 on raster print data representedin the color specification of the print engine. Therefore, in thepreferred embodiment of the print data processing pipeline 15, thehalftone operation 14 is located after the color space conversionoperation 12.

The assignment of the halftone bits to each pixel of raster print datais performed in image processing operation 1 to build the halftoneplane. As previously mentioned, the print data entering the print dataprocessing pipeline may be text, graphics, or image print data in theform of raster print data, printer control language print data, orgraphics language print data. Firmware operating in the image processingblock operation 1 generates the halftone plane for the correspondinglossy and lossless page strip elements according to the type of halftonealgorithm which will be applied. For example, the halftone bits for thetext print data may be assigned "11", halftone bits for graphics printdata may be assigned "10", halftone bits for image print data may beassigned "01", and the halftone bits indicating that no halftoneoperation is to be applied to the print data corresponding to the pixelmay be assigned "00". The assignment of the halftone bits allows theapplication of a halftone operation optimized for the type of print dataassociated with the halftone bits. For example, the halftone bits mayspecify halftone algorithms having line screens with different numbersof lines per inch. Halftone operations are well known in the art ofprinting. Further information regarding halftoning can be found inUlichney, R, Digital Halftoning, ISBN 0-262-21009-6 (fourth printing1993) incorporated herein by reference.

Merge operation 13 receives as inputs the lossless raster print datastream, the lossy raster print data stream, the halftone print datastream, and the merge print data stream. Each of these print datastreams is formed from eight bit bytes. The print data representing asingle color plane of the print engine color specification for each ofthe pixels of the entire page is contained in the lossless and lossyraster print data streams. The function of the merge operation 13 is tocombine, pixel by pixel, these two raster print data streams so that theoriginal image, previously split into lossless and lossy page stripelements, is reconstructed for the color plane being processed.Subsequent passes of lossy and lossless raster print data through themerge operation 13 reconstructs the original image for the remainingplanes of the print engine color specification. Each of the pixelscorresponds to a location on what will be the printed page. Thereconstruction process can be regarded as a spatial synchronization ofthe lossless and lossy raster print data streams to generate theoriginal image. Furthermore, to achieve the spatial synchronization, thelossless and lossy raster print data streams and the print data streamof halftone bits must be synchronized in time.

Configuration of the print data processing pipeline 15 is performedbefore and during the passage of print data through the print dataprocessing pipeline 15. Some parameters of the pipeline can beconfigured for each page, some for each color plane, and some for eachpage strip. The number of lines per page and the number of pixels perline are configurable on a page basis. In addition, the number of colorplanes processed by the print data processing pipeline 15 (i.e. will theimage be printed in monochrome or full color) is configurable on a pagebasis.

Processing the raster print data for each color plane requiresconfiguration of the color space conversion operations 3, 9, 12. Priorto the performance of color space conversion operations 3, 9, 12, thecolor space conversion table required for conversion to the intendedcolor plane of the output color space is loaded. Furthermore, processingof each color plane through halftone operation 14 involves configurationof halftone operation 14 so that the correct halftone table is used forhalftoning the color plane. For example, when processing successivecolor planes of an image, each halftone table may correspond to ahalftoning algorithm using the selected line screen at a differentrelative angle. As is well known in the art of halftoning, use of aselected line screen at different relative angles for successivelyprinted color planes reduces interaction between the color planes whichproduces print artifacts.

The print data processing pipeline 15 also has parameters configurableon a page strip basis. The image processing operation 1 can configurethe print data processing pipeline 15 to perform the various availablepipeline processing operations for each page strip. For example, theimage processing operation 1 may configure, on a page strip basis, theprint data processing operation 15 to perform or bypass the compressionoperations 4, 5, the decompression operations 7, 8, 10, 11, the colorspace conversion operations 3, 9, 1 2, or the halftone operation 14. Inaddition, the number of bits per pixel for the lossless page stripelements may be specified as 1, 2, 4, or 8 on a page strip basis. Forthe preferred embodiment of the print data processing pipeline 15, thecompression algorithm employed in lossy compression operation 5 requires8 bits per pixel for the lossy page strip element. Furthermore, imageprocessing operation 1 may specify that the lossy or lossless componentof a page strip is formed from null data and that each bit of thecorresponding merge plane is of the same value.

Shown in FIG. 2B is a simplified hardware block diagram of the preferredembodiment of the print data processing pipeline 15. It should be notedthat the paths connecting the functional blocks shown in FIG. 2Brepresent data paths. Not shown in FIG. 2B are the various control linesused to control the flow of data between the functional blocks. In thepreferred embodiment, the compression/decompression operations 4, 5, 7,8, 10, 11, the color space conversion operations 3, 9, 12, the mergeoperation 13, and the halftone operation 14 are implemented in an ASIC120. The preferred embodiment of print data processing pipeline 15 isconfigured for connection of the ASIC 120 to a PCI bus. However, one ofordinary skill in the art will recognize that print data processingpipeline 15 may be configured for connection to other types of busses,such as a VESA bus. The PCI bus architecture is well known in the art ofdigital system design and will not be discussed in detail. Imageprocessing operation 1 is performed by a processor, such asmicroprocessor 132, which communicates with the print data processingpipeline 15 over the PCI bus. Print data is retrieved from and loadedinto raster print data memory 2 and compressed raster print data memory6 as it is transferred to and from ASIC 120.

ASIC 120 interfaces to the PCI bus through the PCI bus interface 121.PCI bus interface 121 includes registers necessary for configuration ofthe PCI bus interface 121 and registers used for buffering print data asit flows between the PCI bus and ASIC 120.

A direct memory access controller, such as video DMA 122, controls theflow of print data into and out of the parts of ASIC 120 which performthe various functions of print data processing pipeline 15. Video DMAbuffer 123 temporarily stores print data as it passes through video DMA122 to match the print data rates between the PCI bus and the variousfunctional blocks of ASIC 120 as print data moves into and out of ASIC120. Use of the video DMA buffer compensates for the mismatch in therate of data flow between the PCI bus interface 121 and the functionalblocks in the remainder of ASIC 120.

Several important advantages result from the implementation of the printdata processing pipeline 15 in ASIC 120. A first advantage is theefficient way in which the processing operations for the print dataprocessing pipeline 15 are accomplished internal to ASIC 120. Bylocating all of the operations on ASIC 120, print data can betransferred between successive operations without incurring theprocessing overhead which would result if transfers of print data tookplace over the PCI bus between separate integrated circuits dedicated toperforming single print data pipeline processing operations. A secondadvantage is the ability to configure ASIC 120 to selectively bypassprint data around functional blocks within the ASIC 120. A thirdadvantage is the ability to selectively feedback the output of afunctional block to the video DMA 122 for routing to another functionalblock or for storage in memory. These capabilities create an extremelyflexible and efficient print data processing pipeline which can beconfigured to optimize the print data processing operations dependingupon the type of print data. Because ASIC 120 can be configured toperform a specific subset of the possible print data processingoperations, the operations applied to the print data can be adapted tothe characteristics of the print data in a wide variety of ways. Thisallows the printing system to configure the pipeline for optimalprocessing of all possible types of print data. The feedback capabilityallows the print data processing operations to be performed in an orderbest suited to prepare the print data for printing a page. Aftercompletion of an operation in the print data processing pipeline 15, theresults can be steered by video DMA 122 to the next operation.

Depending upon the type of operation the print data processing pipeline15 is to perform upon the print data loaded from the PCI bus, the videoDMA 122 will be configured to deliver the print data to the appropriatefunctional block in ASIC 120. If color space conversion is required,print data is sent by video DMA 122 to page strip manager 124. Pagestrip manager 124 sends the print data from the video DMA 122 into theappropriate lossy or lossless input of color space converter 125. Inaddition, page strip manager 124 extracts the merge data and thehalftone data interleaved with the lossless raster print data sends eachof these over separate byte wide channels to merge unit 128. Ifcompression or decompression of print data is required, print data isdirected by video DMA 122 to the appropriate compression ordecompression input on lossy compressor/decompressor 126 or losslesscompressor/decompressor 127. Merge unit 128 performs the merge operation13 on the lossy and lossless raster print data streams emerging fromcolor space converter 125. Line buffer 129 includes SRAM for bufferingof the lossy and lossless raster print data and the merge and halftonedata used in the merge operation 13. Halftone unit 130 performs thehalftone operation 14 on the merged raster print data stream,corresponding to each of the pixels, according to the bits specified inthe halftone plane. Although not explicitly shown in FIG. 2B, both thecolor space converter 125 and the halftone unit 130 can be configured tobypass print data around these functional blocks if the operations to beperformed upon the print data do not include color space conversionand/or halftoning.

As operations are completed upon print data flowing through the printdata processing pipeline 15 of FIG. 2A, the print data may betransferred from ASIC 120 into memory and at a later time back into ASIC120 for further processing. For example, after the lossy 5 and lossless4 compression operations are performed, respectively, in the lossy 126and lossless 127 compressors/decompressors, the resulting compressedraster print data can be routed to video DMA 122, through the PCI businterface 121, and then over the PCI bus to the compressed raster printdata memory 6. When the compressed raster print data is to bedecompressed, it is transferred over the PCI bus to ASIC 120 fromcompressed raster print data memory 6, through PCI Bus Interface 121 andthen it is directed by video DMA 122 into the decompress input of eitheror both lossy 126 and lossless 127 compressors/decompressors. After thecolor space conversion operation 3 is performed upon the lossy and/orlossless raster print data, the resulting raster print data could bereturned to the lossy 126 compressor/decompressor and/or lossless 127compressor/decompressor through video DMA 122, or, it could be returnedto raster print data memory 2 through video DMA 122, and PCI businterface 121, or, it could be sent to merge unit 128 for performing themerge operation 13. Included in color space converter 125 is a selectorwhich directs the lossy or lossless color space converted raster printdata to the lossy or lossless outputs of color space converter 125 whichare coupled to the lossy and lossless print data inputs on merge unit128.

The page strip manager 124 manages the raster print data so that thecolor space conversion operations 3, 9, 12, the merge operation 13, andthe halftone operation 14 of print data processing pipeline 15 receive astream of raster print data having a uniform format. For example, insituations in which only a single lossy or lossless page strip elementis generated in image processing operation 1, page strip manager 124will generate a corresponding lossy or lossless page strip element, asis appropriate, of blank print data so that corresponding lossy andlossless page strip elements will be sent on the lossy and losslesspaths to color space converter 125. In addition, for the case in whichonly a single lossy or lossless page strip element is generated by imageprocessing operation 1, the page strip manager 124 generates thecorresponding merge plane which will be formed of the same bitcorresponding to each pixel of the page strip element. Furthermore, forthe case in which the same halftone processes are applied to each pixelof the page strip, the page strip manager 124 will generate the halftoneplane corresponding to the page strip The page strip manager 124 willsend the merge data and the halftone data over separate byte wide pathsto the merge unit 128.

The page strip manager 124 receives the decompressed lossy and losslessraster print data over separate byte wide channels. When compressedlossy raster print data is decompressed by lossy compressor/decompressor126, the resulting 8 pixel by 8 pixel blocks for each dimension of thecolor space will be stored in three 64 byte output buffers included inlossy compressor/decompressor 126. Page strip manager 124 receives abyte wide stream of the lossy raster print data sent from the threeoutput buffers. The bytes of the decompressed lossy raster print datacorresponding to each pixel are sent from the output buffers of lossycompressor/decompressor 126 as three successive bytes with one bytecorresponding to each dimension of the color space. For example, thefirst of the three successive bytes might correspond to the "Y"component, the second to the "Cb" component, and the third to the "Cr"component. The page strip manager 124 assembles the three correspondingbytes of lossy raster print data for a pixel and sends them as a 24 bitwide stream of lossy raster print data to color space converter 125.

The page strip manager 124 receives the decompressed lossless rasterprint data as a byte wide stream of three successive bytes for eachlossless pixel. For example, the first of the three successive bytesmight correspond to the "R" component, the second to the "G" component,and the third to the "B" component. Interleaved with the lossless rasterprint data sent from lossless compressor/decompressor 127 are the mergedata and the halftone data. The interleaving is done so that bytes oflossless raster print data corresponding to a single line on the printedpage are sent, followed by the necessary number of bytes of merge dataand halftone data to correspond to the line of lossless raster printdata. Page strip manager 124 extracts the merge data and the halftonedata and sends them over separate channels to merge unit 128. Page stripmanager 124 assembles the three corresponding bytes of lossless rasterprint data for a pixel and sends them as a 24 bit wide stream oflossless raster print data to color space converter 125.

In some cases Video DMA 122 bypasses the compression step and sendsraster print data directly to page strip manager 124. This may be donewhen a page of raster print data is sent to the print engine 16 withoutcompression and storage in compressed raster print data memory 6. Inthis case raster print data flows through the print data processingpipeline 15 in a linear fashion without taking any of the variousfeedback paths. It is also possible that raster print data could be sentdirectly from Video DMA 122 to page strip manager 124, through thesubsequent print data processing pipeline 15 processing operations, suchas color space conversion and halftoning, return on a feedback paththrough video DMA 122 for sending to the appropriate compressor, andthen return the compressed raster print data to Video DMA 122 forstorage in memory.

The lossless raster print data can be specified by one bit, two bits,four bits, or eight bits per dimension of the color space for eachpixel. Prior to sending the lossless raster print data to color spaceconverter 125, page strip manager 124 converts one bit, two bit, andfour bit representations to a full eight bit per dimension of each pixelrepresentation. The parameters of the raster print data can changebetween page strip elements as well as having different types of printdata processing pipeline operations applied to each of the page stripelements. Page strip manager 124 performs the operations necessary sothat a seamless (seamless in the sense that raster print data formatdifferences between page strip elements are eliminated and in the sensethat there is little variation in the flow rate of raster print datathrough the print data processing pipeline 15) stream of uniform formatraster print data is delivered to downstream print data processingpipeline operations.

Providing a number of specific examples of the type of print dataprocessing operations likely to be performed will better illustrate theconsiderable versatility of the print data processing pipeline 15implemented in ASIC 120. Consider a first case in which a page is to beprinted using raster print data expressed in the CYMK engine colorspecification on which no compression/decompression operations have beenperformed and for which halftoning will be applied to the raster printdata. The lossy and lossless raster print data is transferred, a colorplane at a time, from system memory through the PCI bus interface 121.Video DMA 122 sends the lossy and lossless raster print data throughpage strip manager 124 to the color space converter 125 which has beenconfigured to bypass the print data. The merge unit 128 performs themerge operation 13 on the lossy and lossless raster print data and sendsthe merged print data to the halftoning unit 130 for the halftoneoperation 14. The halftoned raster print data is sent through the printengine interface 131 to the print engine 16. In this first case, theprint data processing pipeline 15 was configured to perform only themerge operation 13 and the halftone operation 14.

In a second case, the print data processing pipeline 15 is configured toperform a decompression operation 10, 11 on the lossy and losslesscompressed raster print data, perform the color space conversionoperation 12, the merge operation 13 and also perform the halftoneoperation 14. The lossy and lossless compressed raster print data istransferred from system memory through the PCI bus interface 121. VideoDMA 122 directs the lossy and lossless compressed raster print data intothe lossy 126 and lossless compressors/decompressors 127 fordecompression. The decompressed lossless and lossy raster print data issent to the color space converter 125 for conversion to one of the colorplanes for each of the four passes of print engine 16. The lossy andlossless color space converted raster print data output from color spaceconverter 125 is sent to merge unit 128 for performing the mergeoperation 13. The halftone operation 14 is performed on the merged printdata output from merge unit 128. The results of the halftone operationare sent back to video DMA 122 for sending through PCI bus interface 121to system memory. This sequence occurs four times in succession togenerate the print data for each color plane of print engine 16. In thissecond case, the print data processing pipeline 15 was configured toreturn the processed print data to system memory for printing at a latertime. Although the video DMA 122 was required to handle all the printdata twice, once during loading and once during storing, multipleoperations were performed on the print data in ASIC 120 without the useof the PCI bus or intervention by the microprocessor 132.

In a third case, the print data processing pipeline 15 is configured toperform a color space conversion operation, a halftone operation, andthen a lossless compression operation. Lossless raster print data istransferred from system memory through the PCI bus interface 121. VideoDMA 122 directs the lossless raster print data to color space converter125 through page strip manager 124 to undergo conversion to a plane ofthe color space of print engine 16. Page strip manager 124 generates thecorresponding blank lossy raster print data and merge print data . Theblank lossy raster print data is bypassed around color space converter125. Merge unit 128 performs a merge operation on the lossless and lossyraster print data using the merge print data generated by the page stripmanager 1 24. Halftone unit 130 performs a halftone operation 14 on themerged raster print data. The raster print data output from the halftoneunit 130 is sent to video DMA 122. Video DMA 122 then directs the rasterprint data to the lossless compressor/decompressor 127 for losslesscompression. The compressed raster print data is returned to video DMAwhich in turns sends the compressed raster print data through PCI businterface 121 to system memory for storage. This sequence occurs fourtimes in succession to generate the print data for each color plane ofprint engine 16. In contrast to the second case, the order in which theprint data processing operations have been performed has been changed.This illustrates the ability of the print data processing pipeline 15 tobe configured to optimize processing of the print data.

Some prior art print data processing pipelines have been implementedusing a general purpose microprocessor to accomplish the various colorspace conversion, compression/ decompression, merge, and halftoneoperations. The speed with which a microprocessor can execute firmwareto accomplish these operations is less than that which can be achievedusing dedicated hardware. Furthermore, using a general purposemicroprocessor to accomplish these operations results in significantdata transfer overhead because of the intermediate print data transfersbetween the microprocessor and memory over the system bus. The largenumber of transfers over the system bus substantially degrades theprocessing capability of a print data processing pipeline implementedusing a general purpose microprocessor.

Print data processing pipelines have been implemented using dedicatedintegrated circuits to accomplish specific functions of the print dataprocessing pipeline. Operations such as color space conversion andcompression/decompression have been implemented in individual integratedcircuits. However, a general purpose microprocessor is still requiredfor moving print data between the various integrated circuits and memoryas the operations of the print data processing pipeline are performed.Although this provides some improvement in the processing time becauseof the use of dedicated hardware, the data transfer overhead is still aperformance limiting factor. The implementation of the print dataprocessing pipeline 15 in ASIC 120 avoids this data transfer overhead byperforming multiple pipeline operations within ASIC 120.

The preferred embodiment of merge unit 128 selects from the lossy andlossless raster print data streams to form a single data stream usingthe merge bits to reconstruct the original image. However, it should berecognized that the techniques used in merge unit 128 are useful tocombine, in a similar fashion, more than two data streams using multiplemerge bits for each unit of data merged. Additionally, the data streamsmerged may include types of data other than raster print data orpartitions of raster print data in ways other than into lossy andlossless raster print data streams. For example, the raster print datastream may be partitioned into multiple streams depending upon theapplication of a halftone operation to the pixels of raster print data.Those pixels of raster print data undergoing a halftone operation wouldbe compressed using a compression operation optimized for halftonedraster print data. Those pixels of raster print data which have not beenhalftoned would undergo a different compression operation. Anotherpossible partition of the raster print data stream would be based uponthe number of bits used to represent each color space dimension of thepixel. For example, areas of a page which contain black and whiteinformation could be represented by fewer bits per pixel than areas ofpages which contain color images. In the most extreme case, some areasof the page might have a full color 24 bit per pixel representation andother areas of the page might have a binary black and white 1 bit perpixel representation. Separately processing a 24 bit per pixel stream ofraster print data and a 1 bit per pixel stream of raster print dataallows optimization of the compression and halftoning operations foreach of the streams. A further possible partition of the raster printdata stream would be based upon the resolution used to represent thepage. Areas of an image which did not contain highly detailed featurescould be printed with a lower resolution such as 600 dpi. Areas of animage which did contain highly detailed features could be printed withhigher resolution such as 1200 dpi. This case may occur when there is aconstant gray scale region with a sharp boundary. Separately processinga higher resolution raster print data stream and a lower resolutionraster print data stream would allow optimization of halftone andcompression operations for each of the raster print data streams.

It should be noted that although the preferred embodiment of the printdata processing pipeline 15 employs a merge unit 128 which performs themerge operation 13 on digital data, it would be possible to implement amerge operation on the surface of the photoconductor drum in printengine 16 through developing, on successive passes, the lossy andlossless raster print data onto the surface of the photoconductor drum.This merge operation would effectively be an OR operation between thelossy and the lossless raster print data as it is developed on thephotoconductor drum. Furthermore, it would also be possible to implementmerge operation 13 on digital data so that an OR operation between thelossy and lossless raster print data is performed, instead of employinga merge plane to specify from which these streams the raster print datais to be selected.

Shown in FIG. 3 is a diagrammatic representation of the operationperformed by merge unit 128. Each of the sections 20-23 are part of SRAMline buffer 129 and each section corresponds to two buffers which holdone of the four types of print data streams entering the merge unit 128.Buffering is required so that sufficient print data is available, asnecessary, from each of the print data streams to perform the mergeoperation 13 without decreasing the raster print data throughput ofmerge unit 128. As the merge unit 128 processes each merge bit, bytes ofraster print data must be available from both the lossless or lossyprint data stream to assign to the pixel being processed. In addition,the halftone bits must be available to maintain the spatial relationshipwith the pixel being processed. For the lossless print data stream, asufficient number of bytes are stored in lossless line buffer 21 tocover two entire scan lines in the print engine if the pixels wereplaced continuously on the printed page. By storing two lines oflossless raster print data in the two buffers which form lossless linebuffer 21, the lossless raster print data can move through lossless linebuffer 21 in a "ping-pong" fashion to maintain high throughput.

The data compression algorithm operating upon the lossy raster printdata in the preferred embodiment of the print data processing pipeline15 operates by partitioning the pixels of the lossy page strip elementto form cells used in the compression operation. The cell size selectedin the preferred embodiment of the print data processing pipeline has awidth of eight pixels and a height of eight pixels. When decompressionis performed upon the compressed lossy rasterized print data, enoughbytes of raster print data to correspond to a block eight pixels inwidth and eight pixels in height are produced as the output of the lossydecompression operation 11. Because decompression of the compressedlossy raster print data is done block by block and to ensure sufficientbuffering of the lossy raster print data output from the color spaceconverter 125, lossy line buffer 20 has the capacity to store two rowsof blocks. Two rows of blocks equates to a sufficient number of pixelsto entirely cover sixteen print engine scan lines. By storing two rowsof blocks of lossy raster print data in the two buffers which form lossyline buffer 20, the lossy raster print data can move through lossy linebuffer 20 in a "ping-pong" fashion to maintain high throughput. Mergeline buffer 22 and halftone line buffer 23 contain, respectively,sufficient merge bits and halftone bits to process two scan lines ofpixels. Therefore, the storage capacity of merge line buffer 22 would beone eighth that of lossless line buffer 21 and the storage capacity ofhalftone line buffer 23 would be one fourth that of the lossless linebuffer 21.

The inputs of print data multiplexor 24 are connected to the outputs oflossy line buffer 20 and lossless line buffer 21. The output of mergeline buffer 22 controls the selection of the input raster print datastream for the output of print data multiplexor 24. Based upon the stateof the merge bit for the pixel undergoing processing, print datamultiplexor 24 selects the raster print data for the pixel beingprocessed from either the lossy raster print data stream or the losslessraster print data stream. The merged raster print data stream from theoutput of print data multiplexor 24 is a combination of the two inputraster print data streams so that the spatial synchronization betweenthe pixels in the original image is maintained in the reconstructedimage. The halftone bits previously assigned to corresponding pixels ofboth the lossless and lossy raster print data streams maintain the pixelby pixel spatial synchronization with the raster print data present whenthe halftone bits entered the merge unit 128.

Shown in FIG. 4 is a high level block diagram of merge unit 128. Thelossy raster print data stream 30 and the lossless raster print datastream 31, each consisting of a stream of eight bit bytes, are stored,respectively, in lossy input buffer 32 and lossless input buffer 33. Thestream of merge bits 34 and halftone bits 35, each formed into a streamconsisting of eight bit bytes, are stored respectively in merge inputbuffer 36 and halftone input buffer 37. The input buffers 32, 33, 36, 37are designed so that each of these print data streams is converted fromeight bits wide to thirty two bits wide when the print data streams aresent from the input buffers 32, 33, 36, 37.

Color space converter interface controller 38 includes the input buffercontrol capability which manages the transfer of the four print datastreams through input buffers 32, 33, 36, 37. This control capabilitysends and receives handshaking signals to and from color space converter125. These handshaking signals control the flow of print data from thecolor space converter 125 to the input buffers 32, 33, 36, 37. Fromthese handshaking signals, color space converter interface controller 38generates the enable signals which allow input buffers 32, 33, 36, 37 toload the appropriate type of print data (lossy, lossless, halftone, ormerge) into the corresponding one of the input buffers 32, 33, 36, 37.The handshaking signals received from the color space converter 125include signals which indicate when lossy and lossless raster print datais available for transfer to the lossy 32 and lossless 33 input buffers.The color space converter interface controller 38 also receiveshandshaking signals which indicate when the merge and halftone printdata is available for transfer to the merge 36 and halftone 37 inputbuffers. The handshaking signals sent from the color space converterinterface controller 38 to the color space converter 125 and the pagestrip manager 124 also include signals which indicate when each of theinput buffers 32, 33, 36, 37 are ready to receive input print data.

The thirty two bit wide data streams 40, 41, 42, 43 output from each ofthe input buffers 32, 33, 36, 37 are sent to the input buffermultiplexor 39. Color space converter interface controller 38 controlsthe flow of the print data streams from the input buffers 32, 33, 36, 37through the input buffer multiplexor 39. Control signals 47 generated bythe color space converter interface controller 38 select one of thethirty two bit wide data streams 40, 41, 42, 43 for transfer to the SRAMinterface controller 44. A state machine (not shown separately) includedin the color space converter interface controller 38 generates thecontrol signals 47 which determine which of the print data streams frominput buffers 32, 33, 36, 37 will be selected by input buffermultiplexor 39 for transfer to SRAM interface controller 44.

SRAM interface controller 44 and color space converter interfacecontroller 38 each generate the necessary handshake signals 45 totransfer print data through the input buffer multiplexor 39 to the SRAMinterface controller 44. SRAM interface controller 44 generates ahandshake signal which indicates to the color space converter interfacecontroller 38 that the SRAM interface controller 44 is ready to receiveprint data. The color space converter interface controller 38 providescontrol signals to identify the type of print data (lossy, lossless,halftone, or merge) sent from input buffer multiplexor 39. Print datareceived by the SRAM interface controller 44 is stored in SRAM linebuffer 129. SRAM line buffer 129 is partitioned into sectionscorresponding to each of the print data types (lossy, lossless,halftone, and merge). The line buffers 20-23 in SRAM line buffer 129correspond to those depicted in FIG. 3. Storage of the print data in theSRAM line buffer 129 ensures that sufficient print data is available toperform the merge operation uninterrupted. The print data received bythe SRAM interface controller 44 is stored in the appropriate section ofSRAM line buffer 129 as determined by the control signals 45 from thecolor space converter interface controller 38. The print data stored inSRAM line buffer 129 is loaded into SRAM interface controller 44 so thatthe print data is available for performing the merge operation 13. Printdata is stored into and loaded from SRAM line buffer 129 over a singlebi-directional thirty two bit wide bus 49. Although this bus 49 isdepicted in FIG. 3 as two uni-directional buses, the preferredembodiment of the merge unit 128 uses a single bi-directional bus. SRAMinterface controller 44 generates the addresses to access storagelocations in the SRAM line buffer 129 over address bus 50.

Print data loaded from SRAM line buffer 129 into SRAM interfacecontroller 44 is transferred to output buffers 51, 52, 53, 54 inpreparation for performing the merge operation. Output buffers 51, 52,53, 54 include the lossy output buffer 51, the lossless output buffer52, the merge output buffer 53, and the halftone output buffer 54. Thehalftone output buffer 54 and the merge output buffer 53 are each formedfrom shift registers. The use of shift registers allows thirty two bitwords of the halftone print data and the merge print data to bepartitioned into the pairs of bits (halftone print data) or individualbits (merge print data) which will be matched with raster print datacorresponding to the commonly associated pixel. Transfer of the printdata from the SRAM interface controller to the output buffers 51, 52,53, 54 is managed by control signals 56 between the halftone interfacecontroller 55 and SRAM interface controller 44. The control signals 56include signals which indicate when each of the output buffers 51, 52,53, 54 is ready to receive the corresponding type of print data (lossy,lossless, halftone, merge) and include signals which indicate when SRAMinterface controller 44 has print data available for transfer to outputbuffers 51, 52, 53, 54.

Halftone interface controller 55 generates control signals 57 whichcontrol the transfer of print data through output buffers 51, 52, 53,54. The input print data stream into each of output buffers 51, 52, 53,54 is thirty two bits wide. The lossy and lossless raster print datastreams output from lossy raster print data output buffer 51 andlossless raster print data output buffer 52 are each eight bits wide.The control signals 57 include the enable signals which allow theappropriate print data type to be loaded into the corresponding outputbuffers 51, 52, 53, 54. Included in each of the lossy 51 and lossless 52raster print data output buffers is a multiplexor (not shown in FIG. 4)which selects one of the four eight bit bytes included in the thirty twobit wide lossy and lossless raster print data streams for transfer toprint data multiplexor 24. The control signals 57 include the signalsnecessary to control the multiplexors which are part of the lossy outputbuffer 51 and lossless output buffer 52. The control signals 57generated by halftone interface controller 55 include the signalsnecessary to load the thirty two bit wide halftone and merge datastreams into the corresponding halftone data output buffer 54 and mergedata output buffer 53. As previously mentioned, the halftone data outputbuffer 54 and the merge data output buffer 53 each include shiftregisters. In addition, the halftone data output buffer 54 and the mergedata output buffer 53 each include a multiplexor (not shown in FIG. 4)which selects from either the shift right output or the shift leftoutput as determined by a signal included in control signals 57. Thissignal also controls the direction in which the shift register moves themerge data and the halftone data. It is necessary to control thedirection in the shift register moves the merge data and halftone datafor printing in duplex mode. In duplex mode printing the order in whichthe raster print data is delivered to the print engine 16, relative tothe top and bottom of the page, is reversed between printing the frontside and the back side of the page.

Print data multiplexor 24 receives as inputs the byte wide lossy andlossless raster print data streams. The single bit wide merge datastream output from merge output buffer 53 controls the selection of oneof the input raster print data streams for output from merge unit 128.By maintaining the relative order of the merge bits in the merge datastream and the relative order of the lossy and lossless raster printdata in their respective raster print data streams as they were movedthrough the various buffers in the merge unit 128, the merge operation13 performed by print data multiplexor 24 correctly reconstructs, on apixel by pixel basis, the original page. One of ordinary skill in theart of digital design would, after understanding this specification,possess the knowledge to design the logic circuits necessary to performthe functions of print data multiplexor 24.

SRAM line buffer 129 allows establishment of temporal and spatialsynchronization between the lossy and lossless raster print data, themerge data, and the halftone data. Because the decompressed lossy rasterprint data is decompressed in 8 pixel wide and 8 pixel high blocks, thedecompressed lossy raster print data is delivered to the merge unit 128and stored in SRAM line buffer 129 out of synchronization with the otherprint data. The manner in which the print data is removed from SRAM linebuffer 129 establishes the temporal and spatial synchronization. Itshould be noted that merge unit implementations which do not require theuse of SRAM line buffer 129 are possible. If the lossy and losslessraster print data streams and the merge data are supplied to the mergeunit in a temporally and spatially synchronized manner, then the needfor buffering of the print data streams internal to the merge unit 128is eliminated. For the merge unit implementation for which it isnecessary to receive temporally and spatially synchronized print datastreams, the buffering of the print data streams, if necessary, could beperformed external to the merge unit. Furthermore, with temporal andspatial synchronization between the lossy and lossless raster print datastreams and the merge data stream, the merge unit could be significantlysimplified to function using the print data multiplexor 24.

Merge data output buffer 53 operates to convert the byte wide stream ofmerge data into a single bit wide stream synchronized with the lossy orlossless raster print data which represents the corresponding pixel.Although the preferred embodiment of merge unit 128 uses a single bit toselect from the bytes of lossy and lossless raster print data, it shouldbe recognized that a multiple bit wide stream may be used to select frommore than two raster print data streams and the raster print datastreams may use more than eight bits to represent each dimension of thecolor space.

Shown in FIG. 5 is a simplified schematic of the arrangement on theinput side of lossy input buffer 32 which is representative of theoperation of each of the input buffers 32, 33, 36, 37. The exemplarylossy input buffer 32 is formed from eight, eight bit data latches60-67. The eight bit input lossy raster print data stream 68 ispresented to the "DATA" inputs of each of the eight data latches 60-67.The eight three input AND gates 69-76 connected to the "EN" inputs ofthe eight data latches 60-67 decode control signals, generated by thecolor space converter interface controller 38, to select one of theeight data latches 60-67 for loading of a byte of the input print datastream. The decoding logic is part of the color space converterinterface controller 38. As is shown in FIG. 5, the eight data latches60-67 are partitioned into two banks each having four data latches. Thedecoding of the control signals is done so that four successivelytransferred bytes of the print data stream are loaded into one of thetwo banks and the next four successively transferred bytes of the printdata stream are loaded into the other of the two banks. Loading inputbuffers 32, 33, 36, 37 so that successively transferred groups of fourbytes of the print data stream are alternately loaded into one of thetwo banks of data latches maintains the flow of print data through inputbuffers 32, 33, 36, 37. While one of the two banks is loaded with inputprint data, transfer of print data out of the other of the two banks canoccur.

Shown in FIG. 6 is a simplified schematic of the arrangement on theoutput side of lossy input buffer 32 which is representative of theoperation of each of the input buffers 32, 33, 36, 37. The "OE" inputsof the eight data latches 60-67 are connected to a fixed logic level sothat the lossy raster print data stored in the lossy input buffer 32 isoutput from the data latches 60-67 on the rising edge of each clockcycle. The four eight bit outputs of each of the two banks of lossyinput buffer 32 form two, thirty two bit wide print data streams. Thesetwo, thirty two bit wide print data streams are connected to the inputsof multiplexor 70. One of these two, thirty two bit wide print datastreams is selected for input to input buffer multiplexor 39. Theselection is performed by multiplexor 70 using a control signalgenerated by the color space converter interface controller 38. Thiscontrol signal detects which of the two banks of input buffers 32, 33,36, 37 is full and ready to have the print data contained within it sentto the input buffer multiplexor 39. Transferring print data out of inputbuffers 32, 33, 36, 37 so that one of the group of four bytes stored ineach of the two banks is alternately selected, maintains the flow ofprint data through input buffers 32, 33, 36, 37 and maintains the flowof print data to input buffer multiplexor 39. While four bytes of printdata are transferred out of one of the two banks, loading of four bytesof print data into the other of the two banks can occur.

Shown in FIG. 7 is a simplified schematic of the arrangement of theinput side of the lossy output buffer 51 and lossless output buffer 52.Each of the lossy 51 and lossless 52 output buffers includes two banksof four eight bit data latches 80-95. The thirty two bit wide lossyraster print data stream and lossless raster print data stream internalto merge unit 128 are each partitioned into four, eight bit wide lossyor lossless raster print data streams which are presented to the "DATA"inputs of each of the respective data latches 80-95. The "EN" inputs ofeach of data latches 80-95 control the loading of the lossy and losslessraster print data into the data latches 80-95. The four AND gates 96-99are part of the halftone interface controller 55 and are used to decodecontrol signals generated by the halftone interface controller 55 whichcontrol loading of the data latches 80-95. While lossy and losslessraster print data is loaded into one pair of banks of data latches80-95, lossy or lossless raster print data can be sent out of the otherpair of banks of data latches 80-95. Use of this buffering methodmaintains the flow of print data through the lossy and lossless outputbuffers 51, 52.

Shown in FIG. 8 is a simplified schematic of the arrangement of theoutput side for one pair of lossy and lossless banks of data latches80-83, 88-91 for lossy 51 and lossless 52 output buffers. The outputside for the other two banks of data latches 84-87, 92-95 for lossy 51and lossless 52 output buffers is implemented similarly. The lossy 51and lossless 52 output buffers convert the thirty two bit wide inputlossy and lossless raster print data stream into an eight bit wide lossyand lossless raster print data stream. The "OE" inputs of the eight datalatches 80-83, 88-91 are connected to a fixed logic level so that thelossy and lossless raster print data stored in these data latches 80-83,88-91 is output on the rising edge of each clock cycle. The multiplexors100, 101 are used to select one of the eight bit outputs from therespective data latches 80-83, 88-91 for input to print data multiplexor24. The eight bit outputs from the respective data latches 80-83, 88-91are selected by the respective multiplexors 100, 101 so that therelative order of the eight bit bytes in the respective lossy andlossless raster print data streams is maintained. This is necessary sothat the merge operation 13 performed by print data multiplexor 24correctly reconstructs the original page. The signals used to controlmultiplexors 100, 101 are generated by the halftone interface controller55. The stream of merges bits output by merge output buffer 53 controlthe selection, by print data multiplexor 24, of eight bit bytes from thelossy and lossless raster print data streams. The raster print datastream emerging from print data multiplexor 24 is eight bits wide andconsists of the merged lossy and lossless raster print data streams.

Shown in FIG. 9 are simplified schematics of the halftone output shiftregister 110 and the merge output shift register 111. The thirty two bitwide halftone print data stream 112 and the thirty two bit wide mergeprint data stream 113 are loaded into the respective output shiftregisters 110, 111. Signals from the halftone interface controller 55 tothe "LD" inputs on each of the output shift registers 110, 111 controlloading of the halftone and merge print data. The use of shift registers110, 111 allows the byte aligned halftone print data and merge printdata to be partitioned into, respectively, a two bit wide and a singlebit wide stream of print data so that the relative order of these twodata streams is maintained with respect to the lossy and lossless rasterprint data streams.

The AND gates 114, 115, included in halftone interface controller 55,control the shifting of the merge print data and the halftone print dataout of their respective shift registers 110, 111. When the "EN" inputsof the shift registers 110, 111 are asserted, the respective registerswill shift out merge print data and halftone print data. Depending uponthe level of the "DIR" input to the shift registers 110, 111, the mergeand halftone print data will be shifted out of the "SLD" or "SRD" outputon the rising edge of the clock. The "DIR" input controls the directionof the shifting of the merge and halftone print data in the registers110, 111 so that the relative order of the merge and halftone print datastreams is maintained relative to the lossy and lossless raster printdata streams. Depending upon how the merge and halftone bits areordered, with respect to the least and most significant bits of thethirty two bits, when they are formed into their respective thirty twobit wide print data streams internal to merge unit 128, the "DIR" inputswill be controlled to maintain spatial synchronization with the lossyand lossless print data streams.

The halftone print data stream shifted out of shift register 110 is twobits wide and the merge print data stream shifted out of shift register111 is a single bit wide. Multiplexors 116, 117 are controlled by thesame signal which is connected to the "DIR" inputs of shift registers110, 111 to select the "SRD" or "SLD" outputs of the shift registers110, 111 to output from the multiplexors 116, 117. The single bit widestream of merge print data output from multiplexor 117 is connected tothe control input of print data multiplexor 24 to select, pixel bypixel, from the lossy or lossless raster print data streams. The outputprint data from the merge unit 128 includes the eight bit wide mergedraster print data stream output from buffer multiplexor 24 and the twobit wide halftone print data stream output from multiplexor 116.

Although several embodiments of the invention have been illustrated, andtheir forms described, it is readily apparent to those of ordinary skillin the art that various modifications may be made therein withoutdeparting from the spirit of the invention or from the scope of theappended claims.

What is claimed is:
 1. A data processing pipeline for separatelyprocessing a first data stream formed, alternatively, from lossless dataincluding lossless data elements or compressed lossless data includingcompressed lossless data elements and a second data stream formed,alternatively, from lossy data including lossy data elements orcompressed lossy data including compressed lossy data elements, saiddata processing pipeline using a merge data stream defined by said firstdata stream and said second data stream and formed of merge dataincluding merge data elements corresponding to, alternatively, saidlossless data elements and said lossy data elements or said compressedlossless data elements and said compressed lossy data elements, saiddata processing pipeline comprising:a lossless compressor/decompressorhaving a first input to receive said first data stream and having alossless decompressed output and a lossless compressed output, saidlossless compressor/decompressor to perform alternatively, losslesscompression and lossless decompression to generate a first transformeddata stream including alternatively, said compressed lossless data andsaid decompressed lossless data, said lossless compressor/decompressorincludes a configuration to receive said merge data to generatecompressed merge data and to receive said compressed merge data togenerate decompressed merge data; a lossy compressor/decompressor havinga second input to receive said second data stream and having a lossydecompressed output and a lossy compressed output, said lossycompressor/decompressor to perform alternatively, lossy compression andlossy decompression to generate a second transformed data streamincluding, alternatively, compressed lossy data and decompressed lossydata; a direct memory access controller coupled to said losslesscompressed output and said lossy compressed output, said direct memoryaccess controller having a third input to receive at least one of saidlossless, said compressed lossless, and said decompressed lossless data,said lossy, said compressed lossy, and said decompressed lossy data, andsaid merge, said compressed merge, and said decompressed merge data,said direct memory access controller includes a configuration to send atleast one of said lossless, said compressed lossless, and saiddecompressed lossless data, and said merge, said compressed merge, andsaid decompressed merge data to said lossless compressor/decompressorand said direct memory access controller includes a configuration tosend at least one of said lossy, said compressed lossy, and saiddecompressed lossy data to said lossy compressor/decompressor and; amerge unit configured to receive said first transformed data streamincluding said decompressed lossless data, said second transformed datastream including said decompressed lossy data, and said merge datastream, said merge unit to merge said first transformed data stream andsaid second transformed data stream into an output data stream usingsaid merge data stream.
 2. The data processing pipeline as recited inclaim 1, wherein:said output data stream includes merged lossless andlossy data; and said merge unit includes a configuration to receive saidlossless data, said lossy data, and said merge data to generate saidmerged lossless and lossy data.
 3. The data processing pipeline asrecited in claim 2, further comprising:a page strip manager coupled tosaid lossless decompressed output, said lossy decompressed output, andsaid direct memory access controller; said page strip manager having afirst lossless output, a first lossy output, and a merge data outputcoupled to said merge unit; and a color space converter coupled to saidfirst lossless output and said first lossy output, each of said firstand said second transform includes a color space conversion, said colorspace converter having a second lossless output and a second lossyoutput coupled to said merge unit.
 4. The data processing pipeline asrecited in claim 3, wherein:said color space converter includes thecapability to bypass said lossless data, said decompressed losslessdata, said lossy data, and said decompressed lossy data through saidcolor space converter; and said color space converter includes aselector having a selector output coupled to said direct memory accesscontroller for selecting from said lossless data and said lossy data andfrom said decompressed lossless data and said decompressed lossy data.5. The data processing pipeline as recited in claim 4, wherein:saidlossless data and said lossy data include, respectively, lossless rasterprint data and lossy raster print data for use in a printing system andsaid merged lossless and lossy data includes merged lossless and lossyraster print data; and said page strip manager includes the capabilityto format at least one of said lossless raster print data, saiddecompressed lossless raster print data, said lossy raster print data,and said decompressed lossy raster print data for subsequent processingoperations.
 6. The data processing pipeline as recited in claim 5,wherein:said printing system includes an electrophotographic printingsystem.
 7. The data processing pipeline as recited in claim 6, furthercomprising:a halftone unit coupled to said merge unit to receive saidmerged lossless and lossy raster print data and to selectively perform ahalftone operation on said merged lossless and lossy raster print dataresponsive to halftone data.
 8. A print data processing pipeline forseparately processing a first print data stream formed, alternatively,from lossless data including lossless data elements or compressedlossless data including compressed lossless data elements and a secondprint data stream formed, alternatively, from lossy data including lossydata elements or compressed lossy data including compressed lossy dataelements, said print data processing pipeline using a merge data streamdefined by said first print data stream and said second print datastream and formed of merge data including merge data elementscorresponding to, alternatively, said lossless data elements and saidlossy data elements or said compressed lossless data elements and saidcompressed lossy data elements, said print data processing pipelinecomprising:a lossless compressor/decompressor having a first input toreceive, said first print data stream and having a lossless decompressedoutput and a lossless compressed output, said losslesscompressor/decompressor to perform alternatively, lossless compressionand lossless decompression to generate a first transformed print datastream including, alternatively, said compressed lossless data and saiddecompressed lossless data said lossless compressor/decompressorincludes a configuration to receive said merge data to generatecompressed merge data and to receive said compressed merge data togenerate decompressed merge data; a lossy compressor/decompressor havinga second input to receive said second print data stream and having alossy decompressed output and a lossy compressed output, said lossycompressor/decompressor to perform alternatively, lossy compression andlossy decompression to generate a second transformed print data streamincluding, alternatively, compressed lossy data and decompressed lossydata; a direct memory access controller coupled to said losslesscompressed output and said lossy compressed output, said direct memoryaccess controller having a third input to receive at least one of saidlossless, said compressed lossless, and said decompressed lossless data,said lossy, said compressed lossy, and said decompressed lossy data, andsaid merge, said compressed merge, and said decompressed merge data,said direct memory access controller includes a configuration to send atleast one of said lossless, said compressed lossless, and saiddecompressed lossless data, and said merge, said compressed merge, andsaid decompressed merge data to said lossless compressor/decompressorand said direct memory access controller includes a configuration tosend at least one of said lossy, said compressed lossy, and saiddecompressed lossy data to said lossy compressor/decompressor and; amerge unit configured to receive said first transformed print datastream including said decompressed lossless data, said secondtransformed print data stream including said decompressed lossy data,and said merge data stream, said merge unit to merge said firsttransformed print data stream and said second transformed print datastream into an output data stream using said merge data stream.
 9. Theprint data processing pipeline as recited in claim 8, wherein:said mergedata includes decompressed merge data; said first print data streamincludes, alternatively, lossless raster print data and compressedlossless raster print data; said second print data stream includes,alternatively, lossy raster print data and compressed lossy raster printdata; said output print data stream includes merged lossless and lossyraster print data; said lossless compressor/decompressor includes aconfiguration to generate said compressed lossless raster print datafrom said lossless raster print data and to generate decompressedlossless raster print data from said compressed lossless raster printdata; said lossy compressor/decompressor includes a configuration togenerate said compressed lossy raster print data from said lossy rasterprint data and to generate decompressed lossy raster print data fromsaid compressed lossy raster print data; said first transformed printdata stream includes, alternatively, said lossless raster print data,said compressed lossless raster print data, and said decompressedlossless raster print data; and said second transformed data streamincludes, alternatively, said lossy raster print data, said compressedlossy raster print data, and said decompressed lossy raster print data.10. The print data processing pipeline as recited in claim 9, furthercomprising:a processor to generate said lossless raster print data, saidlossy raster print data, and said merge data from print data to send tosaid third input of direct memory access controller.
 11. The print dataprocessing pipeline as recited in claim 10, further comprising:a pagestrip manager coupled to said lossless decompressed output, said lossydecompressed output, and said direct memory access controller; said pagestrip manager having a first lossless output, a first lossy output, anda merge data output coupled to said merge unit; and a color spaceconverter coupled to said first lossless output and said first lossyoutput, said color space converter having a second lossless output and asecond lossy output coupled to said merge unit.
 12. The print dataprocessing pipeline as recited in claim 11, wherein:said color spaceconverter includes the capability to bypass said lossless raster printdata, said decompressed lossless raster print data, said lossy rasterprint data, and said decompressed lossy raster print data through saidcolor space converter; and said color space converter includes aselector having a selector output coupled to said direct memory accesscontroller for selecting from said lossless raster print data and saidlossy raster print data or from said decompressed lossless raster printdata and said decompressed lossy raster print data.
 13. The print dataprocessing pipeline as recited in claim 12, wherein:said page stripmanager includes the capability to format at least one of said losslessraster print data, said lossy raster print data and said merge data, andsaid decompressed lossless raster print data, said decompressed lossyraster print data, and said decompressed merge data for subsequentprocessing operations.
 14. The print data processing pipeline as recitedin claim 13, further comprising:a halftone unit coupled to said mergeunit to receive said merged lossless and lossy raster print data and toselectively perform a halftone operation on said merged lossless andlossy raster print data responsive to halftone data.
 15. The print dataprocessing pipeline as recited in claim 14, wherein:said printerincludes an electrophotographic printer.
 16. A printer, comprising:aprocessor to generate a first print data stream formed, alternatively,from lossless data including lossless data elements or compressedlossless data including compressed lossless data elements, a secondprint data stream formed, alternatively, from lossy data including lossydata elements or compressed lossy data including compressed lossy dataelements and to generate a merge data stream defined by said first printdata stream and said second print data stream and formed of merge dataincluding merge data elements corresponding to, alternatively, saidlossless data elements and said lossy data elements or said compressedlossless data elements and said compressed lossy data elements; a directmemory access controller configured to receive said first print datastream, said second print data stream, and said merge data stream fromsaid processor; a lossless compressor/decompressor having a first inputto receive said first print data stream from said direct memory accesscontroller and having a lossless decompressed output and a losslesscompressed output, said lossless compressor/decompressor to performalternatively, lossless compression and lossless decompression togenerate a first transformed print data stream including, alternatively,said compressed lossless data and said decompressed lossless data, saidlossless compressor/decompressor includes a configuration to receivesaid merge data to generate compressed merge data and to receive saidcompressed merge data to generate decompressed merge data; a lossycompressor/decompressor having a second input to receive said secondprint data stream from said direct memory access controller and having alossy decompressed output and a lossy compressed output, said lossycompressor/decompressor to perform alternatively, lossy compression andlossy decompression transform on said print data elements of said secondone of said plurality of print to generate a second transformed printdata stream including, alternatively, compressed lossy data anddecompressed lossy data; a page strip manager coupled to said losslessdecompressed output, said lossy decompressed output, and said directmemory access controller; said page strip manager having a firstlossless output, a first lossy output, and a merge data output; a mergeunit coupled to the merge data output and configured to receive saidfirst transformed print data stream including said decompressed losslessdata, said second transformed print data stream including saiddecompressed lossy data, and said merge data stream, said merge unit tomerge said first transformed print data stream and said secondtransformed print data stream into an output print data stream usingsaid merge data stream; and a color space converter coupled to saidfirst lossless output and said first lossy output, said color spaceconverter having a second lossless output and a second lossy outputcoupled to said merge unit.
 17. The printer as recited in claim 16,wherein:said merge data includes, decompressed merge data; said firstprint data stream includes, alternatively, lossless raster print dataand compressed lossless raster print data; said second print data streamincludes, alternatively, lossy raster print data and compressed lossyraster print data; said output print data stream includes mergedlossless and lossy raster print data; said losslesscompressor/decompressor includes a configuration to generate saidcompressed lossless raster print data from said lossless raster printdata and to generate decompressed lossless raster print data from saidcompressed lossless raster print data; said lossycompressor/decompressor includes a configuration to generate saidcompressed lossy raster print data from said lossy raster print data andto generate decompressed lossy raster print data from said compressedlossy raster print data; said first transformed print data streamincludes, alternatively, said lossless raster print data, saidcompressed lossless raster print data, and said decompressed losslessraster print data; and said second transformed print data streamincludes, alternatively, said lossy raster print data, said compressedlossy raster print data, and said decompressed lossy raster print data.18. The printer as recited in claim 17, wherein:said color spaceconverter includes the capability to bypass said lossless raster printdata, said decompressed lossless raster print data, said lossy rasterprint data, and said decompressed lossy raster print data through saidcolor space converter; said color space converter includes a selectorhaving a selector output coupled to said direct memory access controllerfor selecting from said lossless raster print data and said lossy rasterprint data and from said decompressed lossless raster print data andsaid decompressed lossy raster print data; and said page strip managerincludes the capability to format at least one of said lossless rasterprint data, said decompressed lossless raster print data, said lossyraster print data, said decompressed lossy raster print data, said mergedata, and said decompressed merge data for subsequent processingoperations.